Abundance of regular orbits and out-of-equilibrium phase transitions in the 
thermodynamic hmit for long-range systems 
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We investigate the dynamics of many-body long-range interacting systems, taking the Hamiltonian 
Mean Field model as a case study. We show that regular trajectories, associated with invariant tori of 
the single-particle dynamics, prevail. The presence of such tori provides a dynamical interpretation of 
the emergence of long-lasting out-of-equilibrium regimes observed generically in long-range systems. 
This is alternative to a previous statistical mechanics approach to such phenomena which was based 
on a maximum entropy principle. Previously detected out-of-equilibrium phase transitions are also 
reinterpreted within this framework. 



The vast majority of phenomena observed in nature 
results from complex interactions present in large assem- 
blies of elementary constituents. A widespread observa- 
tion is the emergence of regular trajectories despite the 
complexity of the underlying network of couplings. A 
successful approach to describe the collective behaviour 
of large assemblies of particles is traditionally provided 
by statistical mechanics. The theoretical foundation of 
equilibrium statistical mechanics relies upon the hypoth- 
esis of ergodicity, i.e. the agreement of time with ensem- 
ble averages. Arguing for an effective degree of global 
mixing of dynamical trajectories in phase space implies 
ergodicity and thus the validity of statistical mechanics 
Thermodynamic behaviour is obtained in the limit 
where the number of degrees of freedom goes to infinity, 
which offers innumerable pathways to chaos. Indeed, in 
this limit regular regions (invariant tori) do not possess 
enough dimensions in phase space to prevent trajectories 
from spreading, while the largest fraction of the phase 
space is occupied by chaotic motion, hence sustaining 
mixing 12]. 

However, the fact that any weak nonlinearity would 
imply ergodicity has been vigorously debated since the 
pioneering work of Fermi, Pasta and Ulam (FPU) Q 
on the dynamics of oscillators interacting via short-range 
couplings. Contrary to expectations, the celebrated FPU 
chain exhibits a recurrent behavior on very long times, vi- 
olating ergodicity. Nowadays, there is a growing evidence 
that, for generic initial conditions, the relaxation time to 
equilibrium remains finite in the thermodynamic limit Q. 
On the contrary, the question of relaxation to equilibrium 
is still open when long-range forces come into play [1, 
Indeed, systems with long-range interactions have been 
shown to display an extremely slow relaxation to equi- 
librium. More specifically, out-of-equilibrium metastable 
regimes have been identified, where the system gets 
trapped before eventually attaining its asymptotic state 
0, Q • The equilibration time increases with system size 
and formally diverges in the thermodynamic limit, lead- 
ing to a breaking of ergodicity. For gravitational sys- 
tems the approach to equilibrium has never been proven 



and seems problematic. Galaxies could therefore rep- 
resent the most spectacular example of such far-from- 
equilibrium processes [s| , but analogous phenomena have 
also been reported in fundamental problems of plasma 
physics These metastable states have been termed 
Quasi-Stationary States (QSS) in the literature and of- 
ten represent the solely accessible experimental regimes 
(e.g., in the Free Electron Laser [HI). A relevant feature 
of long-range systems is the self-consistent nature of the 
interaction of a particle with its "local field", which itself 
results from the combined action of all the other parti- 
cles or of an "external field" like for wave-particle systems 
[lo| . It is exactly this self-consistency which finally en- 
tails the widespread regularity of the motion. Besides 
that, one observes the presence of classes of initial states 
that show different time evolutions. 

The development of a systematic theoretical treatment 
of the QSS, which would enable us to unravel the puzzle 
of their ubiquity, is still an open problem. Both the self- 
consistent nature of the interaction and the strong de- 
pendence on the initial condition suggest that QSS could 
be related to the presence of some type of regular mo- 
tion. The traditional approach to clarifying the emer- 
gence of regular trajectories is based on the following re- 
sult : If the Hamiltonian system under scrutiny is close to 
integrable, Kolmogorov-Arnold-Moser theory proves 
that the phase space is filled with invariant tori on which 
the motion is quasi-periodic. In this framework, however, 
increasing the number of particles enhances the contribu- 
tion of chaotic trajectories in stringent contradiction 
with the observation that QSS prevail in the large N 
limit. Therefore the aforementioned scenario cannot be 
invoked to explain the presence of regular motion in sys- 
tems with long range interactions. 

A first purpose of this Letter is to put forward a dif- 
ferent interpretative framework. We argue that tori can 
form in phase space also as a result of a self-consistent 
interaction in the thermodynamic limit. As we shall 
demonstrate, while for a small number N of degrees of 
freedom the single particle motion of a paradigmatic sys- 
tem with long-range interaction is erratic, the trajecto- 
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ries become more and more regular as A'' ^ cxd. These 
trajectories arise from a low-dimensional time dependent 
effective Hamiltonian. 

For systems with long-range interactions, the depen- 
dence on the initial condition can materialize in the form 
of a true out-of-equiHbrium phase transition: By varying 
some crucial parameters of the initial state, one observes 
a convergence towards asymptotic states (in the limit 
N — * cxo) with different macroscopic properties (e.g., ho- 
mogeneous/inhomogeneous) This phase transition 

has been interpreted by resorting to Lynden-Bell's the- 
ory of "violent relaxation" which is briefly discussed 
in the following with reference to a speciflc model. As a 
second purpose of this Letter, we provide a microscopic, 
dynamical, interpretation of this transition in terms of a 
sharp modiflcation of the properties of the single particle 
orbits, corresponding to a change of the effective Hamil- 
tonian. Our ultimate aim is to suggest a unifying picture 
that potentially appHes to systems where collective, orga- 
nized, phenomena emerge from the globally coupled sea 
of individual components. 

The Hamiltonian Mean Field (HMF) model [15] is 
widely referred to as the benchmark for long-range sys- 
tems and analysed for pedagogical reasons. The model, 
which describes the evolution of N particles coupled 
through an equally strong, attractive, cosine interaction 
is specifled by the following Hamiltonian: 



N 



2 



N 



1 

2N ^ 



(1 



(1) 



where 0i and pi label respectively the position of particle i 
on the unit circle and its corresponding momentum. Note 
that Hamiltonian (U) can also be seen as a simplified ver- 
sion of the gravitational [l6| or plasma sheets model 
when considering only the first harmonic in the Fourier 
expansion of the potential. To characterize the behaviour 
of the system, it is convenient to introduce the "magne- 
tization" M. — {J2cos9i, ^sin6'i) — M(cos0, sini/)), 
which quantifies the degree of spatial bunching of the 
particles (homogeneity vs. inhomogeneity) . We here con- 
sider water-bag initial conditions, consisting of particles 
uniformly distributed in a rectangle [—Oq, Oq] x [—po, po] 
in the (0,p)-plane. These states bear a magnetization 
M = Mq = sin(0o)/^o, the associated energy per particle 
being U — p^/Q + {\ — Mg)/2. When performing nu- 
merical simulations, starting from the water-bag initial 
condition, the system gets usually frozen in a QSS of the 
type discussed above f?, ^3]. 

The individual particle i obeys the following equations 



of motion pi 



-M sin ( 



and 9i = Pi, where M and 



(p are functions of all the positions of the particles. Nu- 
merical observations suggest that, for large enough values 
of N, both the magnetization M and the phase (j) develop 
a specific oscillatory time dependence. Hence, the single 
particle motion turns out to be governed by a time de- 
pendent one degree of freedom (often referred to as a one 
and a half degree of freedom) effective Hamiltonian. This 
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Figure 1: Poincare sections of a few selected particles of 
one trajectory of Hamiltonian ((TJ for N = 2 x 10^ in the 
QSS regime for two different water-bag initial conditions : 
(Mo,[/) = (0.6,0.54) (upper panel) and (Mo, C/) = (0.6,0.88) 
(lower panel). The former returns a single cluster, which gives 
a non-zero magnetization QSS {Mqss ~ 0.5), while the lat- 
ter shows two symmetric clusters, which produce a QSS with 
a small magnetization. In the bicluster regime (lower panel) 
the presence of a large set of rotational tori implies a sub- 
stantially lower magnetization level, whereas the librational 
tori around the two clusters are responsible for the residual 
magnetization. The color code corresponds to the values of 
the action variable associated with individual particles. 



justifies the investigation of the phase space properties of 
the QSS using a technique inspired by that of Poincare 
sections. In particular, we consider the time average M 
(after a transient) and record the positions and momenta 
of a few selected particles {0i, pi) when M{t) = M and 
dM/dt > (since M typically shows an oscillatory be- 
havior) . The resulting stroboscopic sections are displayed 
in Fig. [TJ Two different phase space structures are found 
depending on the choice of the initial pair (Mq, U), one 
with monocluster and the other with a bicluster. The 
monocluster QSS displays a nonzero magnetization (in- 
homogeneous phase), while the bicluster QSS has a small 
residual magnetization (homogeneous phase). 

The monocluster QSS can be ideally mapped onto a 
collection of weakly interacting pendula. As revealed 
by our stroboscopic analysis, particles evolve on reg- 
ular tracks, which are approximately one-dimensional, 
though they do manifest a degree of local diffusion {thick- 
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Figure 2: Poincare sections of a few selected particles of one 
trajectory of Hamiltonian (HJ, when the system size is varied 
(for Mo = 0.6 and U = 0.54). The thickness of the tori de- 
creases as A'^ is increased (see text). For large enough values 
of A*', the magnetization M is found numerically to approxi- 
mately scale as M{t) ^ M + 5M{t)cosujt, with \5M\ < M 
and \dt5M\ <C tj|M|. Ignoring the time dependence of 5M 
and using a reduced model of test particles in the external 
field M{t), one obtains stroboscopic sections which are qual- 
itatively and quantitatively similar to the ones reported in 
this figure, with the unique difference that the thickness is 
zero [l^l. Considering a torus with action J « 1.9, we plot 
in panel d) its variance AJ computed over a time interval 
At = 300 as a function of A''. The scaling 1/iV (dotted line) 
looks accurate over a wide range of A*' values. 



ness). For the bicluster QSS, the Poincare section shows 
a phase portrait which closely resembles the one obtained 
for a particle evolving in the potential of two contra- 
propagating waves. These latter interact very weakly, as 
the associated propagation velocities appear rather dif- 
ferent. 

In order to get a quantitative estimate of the thickness 
of the tori as a function of the total number of particles, 
we focus on the monocluster QSS. Panels a), b) and c) 
in Fig. [2] display the single particle phase space for in- 
creasing values of TV. A clear trend towards integrability 
is observed as quantified in panel d) , where the thickness 
is plotted versus N. 

Summing up, we have assessed that the single parti- 
cle motion of a typical long-range interacting system be- 
comes progressively more regular as the number of parti- 
cles is increased. This is at variance with what happens 
for systems with short-range interactions and provides a 
different interpretation of the abundance of regular mo- 
tion in long-range dynamics. Besides that, we have seen 
that the features of the single particle motion depend on 
the choice of the initial condition. A natural question 
then arises: what is the link between the macroscopic 
properties of the different QSS with the change observed 
in the single particle dynamics? Anticipating the answer, 
we will see that this is related to a bifurcation occurring 
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Figure 3: Upper panel: Phase diagram in the control param- 
eter plane {Mo,U) of the out-of-equilibrium phase transi- 
tion of the HMF model from a magnetized to a demagnetized 
phase. The solid curve pinpoints the position of the bifurca- 
tion from the monocluster to the bicluster QSS. The dashed 
line stands for the theoretical prediction based on Lynden- 
Bell's violent relaxation theory (see text). The star refers to 
the tricritical point separating first from second order phase 
transitions. Lower panel: The bifurcation is monitored as 
function of U, for Mq = 0.6. The grey zones highlight the 
width of the resonances. 



in the effective Hamiltonian. 

In the thermodynamic limit, the evolution of the sin- 
gle particle distribution function f{0,p,t) is governed by 
the Vlasov equation This equation also describes the 
mean-field limit of wave-particle interacting systems [lo| . 
It can be reasonably hypothesized that QSS are sta- 
tionary stable solutions of the Vlasov equation Fol- 
lowing these lines, a maximum entropy principle, previ- 
ously developed in the astrophysical context by Lynden- 
Bell [iil, allowed one to predict [13, for the HMF 
model, the occurrence of out-of-equilibrium phase tran- 
sitions, separating distinct macroscopic regimes (magne- 
tized/demagnetized) by varying selected control param- 
eters which represent the initial condition. 

The central idea of Lynden-Bell's approach consists in 
coarse-graining the microscopic one-particle distribution 
function f{0,p, t) by introducing a local average in phase 
space. Starting from a water-bag initial profile, with a 
uniform distribution /o, a fermionic-like entropy can be 
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associated with the coarse grained profile /, namely 



s[f] 



dpde 



/o /o 



1 - 



In 1 - 



(2) 

The corresponding statistical equilibrium, which applies 
to the relevant QSS regimes, is hence determined by max- 
imizing such an entropy, while imposing the conservation 
of the Vlasov dynamical invariants, namely energy, mo- 
mentum and norm of the distribution. The analysis re- 
veals the existence of an out-of-equilibrium phase transi- 
tion from a magnetized to a demagnetized phase [l3.[20|. 

We here reinterpret the transition in a purely dynami- 
cal framework, as a bifurcation from a monocluster QSS 
to a bicluster QSS. Aiming at shedding light on this issue, 
we proceed as follows: For fixed Mq and N, we gradually 
increase the energy U and compute the Poincare sections, 
as discussed above. We then analyze the recorded sec- 
tions by identifying the number of resonances and mea- 
suring the associated width and position (both calculated 
in the p direction). Results for Mq = 0.6 are displayed in 
the lower panel of Fig. [31 the shaded region, bounded 
by the dashed lines, quantifies the width of the reso- 
nances. As anticipated, one can recognize the typical 
signature of a bifurcation pattern. Repeating the above 
analysis for different values of the initial magnetization 
Mo , allows us to draw a bifurcation line in the parameter 
space (Mo,C/). In the upper panel of Fig. [3] we report 
both this bifurcation (full) and the Lynden-Bell phase 
transition (dashed) lines The two profiles resem- 

ble each other qualitatively, and even quantitatively for 
small Mq. The change of the bifurcation type from sub- 



critical to supercritical signaled by the opening of a gap in 
the resonance plot could be associated with the change 
of the order of the phase transition from first to sec- 
ond. These results strongly corroborate our claim that 
the out-of-equilibrium phase transition from magnetized 
to non magnetized QSS corresponds to a bifurcation in 
the single particle dynamics. 

The phenomena here discussed are also found (data not 
shown) in the context of Hamiltonian models deputed to 
describe the interaction between a beam of charged par- 
ticles and a set of self-consistently evolving waves |2ll |. 
A large number of relevant applications, facing the long- 
range nature of the couplings among constituents, fall 
within this rather wide category, ranging from plasma 
models, traveling wave tubes, and free electron lasers [2^ . 
More concretely, the same tendency towards integrabil- 
ity is found in these latter settings, a fact which holds 
promise to eventually result in novel insight, potentially 
relevant for the functioning of the devices. 

In summary, investigating the dynamics of systems 
with long range interactions allowed us to come to an 
interesting and general conclusion: a universal trend to 
organization/integrability of the single particle dynam- 
ics is found as the system size (number of particles) is 
increased. Phase space structures are identified and in- 
terpreted as invariant tori of a time dependent one degree 
of freedom Hamiltonian. Based on this analysis, the out- 
of-equilibrium statistical phase transitions is here under- 
stood from the viewpoint of microscopic dynamics, as a 
bifurcation occurring in the effective Hamiltonian which 
describes the single particle dynamics. 
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